Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update gradio demo to support text/voice conversation #75

Merged
merged 34 commits into from
Aug 16, 2024

Conversation

zqhuang211
Copy link
Contributor

@zqhuang211 zqhuang211 commented Aug 9, 2024

Updated the Gradio demo to support both text and voice conversations. The implementation now caches past_key_values for previous conversation turns.

Updated pyproject.toml and poetry.lock to the latest versions of gradio (providing a more stable UI) and torch (adding mps support for Apple Silicon devices).

For machines with limited memory, use --model_path wandb://fixie/ultravox/model-zhuang.2024-07-31-ultravox.blsp-kd-2b-tinyllama:v5
For better results, use use --model_path wandb://fixie/ultravox/model-zhuang.2024-07-31-ultravox.blsp-kd-2a:v5

Zhongqiang Huang added 9 commits August 6, 2024 23:33
The old poetry.lock results in this error:

>>>
  Hash for scipy (1.13.1) from archive scipy-1.13.1-cp311-cp311-macosx_12_0_arm64.whl not found in known hashes (was: sha256:b1cb21bde5153b65841bb78936ae1f057f64bf3abcd2e6c6ad68d45977db13b4)
@zqhuang211 zqhuang211 requested review from juberti, farzadab and liPatrick and removed request for juberti August 9, 2024 03:24
Zhongqiang Huang added 2 commits August 9, 2024 01:09
ultravox/inference/infer.py Outdated Show resolved Hide resolved
ultravox/inference/infer.py Outdated Show resolved Hide resolved
ultravox/inference/infer.py Show resolved Hide resolved
ultravox/inference/base.py Outdated Show resolved Hide resolved
Justfile Outdated Show resolved Hide resolved
ultravox/inference/base.py Outdated Show resolved Hide resolved
pyproject.toml Outdated Show resolved Hide resolved
pyproject.toml Outdated Show resolved Hide resolved
ultravox/model/ultravox_model.py Outdated Show resolved Hide resolved
ultravox/tools/infer_api.py Outdated Show resolved Hide resolved
@zqhuang211 zqhuang211 requested review from juberti and farzadab August 14, 2024 16:03
@zqhuang211
Copy link
Contributor Author

@juberti @farzadab Please review if all recommendations have been implemented. Please also try to run the demo just gradio

mcloud.yaml Outdated Show resolved Hide resolved
ultravox/model/ultravox_model.py Show resolved Hide resolved
ultravox/inference/infer.py Outdated Show resolved Hide resolved
ultravox/tools/gradio_demo.py Outdated Show resolved Hide resolved
ultravox/inference/infer.py Show resolved Hide resolved
ultravox/tools/gradio_demo.py Show resolved Hide resolved
@zqhuang211 zqhuang211 merged commit e5caca9 into main Aug 16, 2024
1 check passed
@zqhuang211 zqhuang211 deleted the zhuang/support-gradio-conversation branch August 19, 2024 15:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants